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ABSTRACT:  the  problem  of  estimating  the  trajectories  of  an 
unknown  number  ot  contacts  in  a  multisensor-multicontact 
environment  is  considered.  The  data  consists  ol  independent 
and  nonassociated  estimates  or  features  extracted  from 
locally  associated  measurements.  To  avoid  the  computational 
difficulties  of  maximum  likelihood  estimation,  a  clustering 
or  decision-directed  approach  to  unsupervised  learning  is 
employed.  Data  samples  are  clustered  and  trajectory 
estimates  formed  via  a  hierarchical  tree  with  a  criterion  for 
identifying  an  estimate  of  the  number  of  clusters  or  contacts. 
Complications  arise  when  system  observability  poses  a 
problem.  An  algorithm  is  presented  for  scenarios  where  two 
independent  data  segments  are  required  for  observability. 
The  estimation  technique  manages  the  assignment  of  the  data 
segments  by  delaying  decisions  and  converting  decision 
making  to  the  resolution  of  conflicts.  An  sample  of  such  a 
□robiem.  the  simultaneous  estimation  at  trajectories  from 
locally-  associated/globaily-nonassociated  angie-of-  arrival 
data,  is  detailed  and  experimental  results  presented. 

V 

l.  Problem  Statement 

This  paper  is  concerned  with 
simultaneously  estimating  the  parameters  of 
an  unknown  number  of  dynamic  systems.  The 
data  is  comprised  of  independent  and 
nonassociated  samples.  The  problem  is 
illustrated  in  Fig.  i,  where  it  is  desired  to 
estimate  the  state  or  initial  conditions  of 
known  dynamic  systems.  This  problem,  further 
detailed  m  Fig.  2a,  is  typical  of  trajectory 
estimation  in  a  multisensor-multicontact 
environment.  The  measurement  environment 
involves  unlabelled  samples  and,  generally,  no 
prior  knowledge  of  the  parameter  set  or  the 
number  of  contacts  is  available.  An  alternate 
□robiem.  typical  of  texture  analysis  and  image 
segmentation,  is  illustrated  in  Fig.  2b.  This 
problem,  where  the  desired  x,  are  the  ARMA  or 
Markov  parameters,  is  detailed  in  [1],  In  the 
trajectory  estimation  problem,  the 
measurements  received  at  various  sensors  may 
fade  from  one  contact  to  another  providing 
uniabeiied  data  streams.  The  data  is  assumed 
to  be  locally  associated  (supervised) 
permitting  retention  of  the  information,  most 
critical  to  the  task  at  hand,  in  a  reduced  data 
set;  e.g.,  sufficient  statistics  or  features.  This 
data  set  A  -  (a,,  a2.  03,  ....  an)  is  realized 
through  local  processing  of  the  raw  data,  y  (k). 
The  probability  of  a  given  data  stream 
originating  with  a  particular  system  is  not 
xnown  a  onori.  The  problem  is  then,  given  a 
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data  set  A  with  known  probability  structures, 
find  x  ■  (x,  .  x,,....xc)T  where  c  is  the  estimated 
number  of  contacts. 


II.  Mathematical  Formulation 

For  data  streams  with  a  large  number  of 
samples,  the  local  estimate  is  approximately 
Gaussian  with  mean  a:,  and  Fisher  information 
matrix  F,  [1  -3].  If  each  local  estimate  is 
labelled  (supervised),  then  the  measurements 
associated  with  a  given  system  can  be 
clustered  and  the  likelihood  function  is  given 
by 

P(A|x).  Ttf  K  p(ai|xj)l  (1) 

i-llajeA,  1  J 


where  A,  represents  the  cluster  associated 
with  the  j,h  system.  For  simplicity  in 
presentation  it  is  assumed  that  is  a  direct 
measure  of  the  X:,-  extension  to  the  more 
general  problem  follows  readily.  Thus,  the 
maximum  likelihood  solution  for  this  problem 
is  given  by 


£  Fj  (a,  -  x.)  -  0  (2) 

OjtAj 


for  j  -  1,2 . c.  When  the  global  association  is 

not  known  (unsupervised  samples),  attention 
focuses  on  the  mixture  density 


P(Oj|x)  -  £  P(to:)  p(ai|xj,(oj).  (3) 

i-i 
and 


p(A|x)  -  ji  p(cgx),  (A) 

OjtA 


where  oji  is  the  event  that  a,  is  associated  with 
the  jth  ‘system  and  the  p(ti)j)  are  mixing 
parameters  (probability  of  the  event  o»i).  When 
c  and  p(<Oj)  are  known,  it  is  readily  shown  r4.E] 
that  the  maximum  likelihood  estimate  (MLE)  s 
given  by  the  solution  to  the  c-coupled  equations 
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(5) 


X  wJttj.x)  F,(a,-  X)  -  0, 

a^A 


where  W:(aj  x)  -  p  (to j|ct:,x)  has  the  effect  of 
windowing  away  data  not  in  the  vicinity  of  xL. 
tt  is  instructive  to  view  the  form  of  w.  (a.xr) 
for  two  identically  Gaussian  distributed 
clusters  with  means  x,  -  -d/2  and  x2  -  d/2,  and 

variance  ct2.  For  this  case  w.(a)  ■  [1  ♦  exp  (—  —  j]'1 , 

c  o 

and  the  transition  from  the  asymptotic  value  of 
1  for  negative  a  to  the  asymptotic  value  of  zero 
for  positive  a  is  seen  to  be  abrupt  for  large 
relative  separations  of  the  cluster  centers 
(d  -  x2  -  x,  »  o).  Thus,  under  these  conditions 
the  problem  reduces  to  one  of  partitioning  A 
into  c  disjoint  subsets  A1  A2  A^..  Ac,  each 
representing  a  cluster  with  "most  similar* 
samples.  The  more  difficult  problem  of  close 
or  overlapping  clusters  requires  maximization 
of  the  mixture  density.  In  generalizing  the 
problem  tc  include  unknown  mixture  para¬ 
meters  the  constraints  p  (at.)  2  0,  I  p  (cu,)  -  1 
are  imposed.  Maximization  of  (4)  is  a 
nonlinear  iterative  process  that  is 
computationally  intensive  and  concern  exists 
regarding  the  convergence  to  a  global  solution. 
With  c  also  unknown,  the  alternative  approach 
of  employing  a  decision-directed  or  clustering 
procedure  is  attractive  [1.4],  Criteria  for 
measuring  the  quality  of  the  data  partitioning 
is  critical  to  the  overall  performance  [4],  To 
evaluate  a  partitioning  R  -  [A, ,  A2,...AJ,  the 
criterion 

r  ®  n| 

p(A|R)  -  K  I  X  J-  p(cx jj x j, Ai)!  (6) 

aj£AjL  j«1  n  1 


was  suggested  [1],  where  n  is  the  total  number 
of  measurements,  n,  is  the  number  of 
measurements  assigned  in  A:,  and  x{  is  obtained 
via  (2).  1  1 


A  Hierar 

chical  Anoroach  to  Maximum  Like- 

liHaod _ c 

luaierino 

To  begin  the  estimation  or  data  fusion 
process,  we  employ  the  insight  gained  in  the 
previous  section  on  the  natural  way  w,  (a.x) 
tends  to  partition  the  measurement  space. 
Hence,  we  seek  a  partition  that  minimizes  the 
criterion 


c2 
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Note  the  relationship  of  (7),  using  unlabelled 
data,  to  the  log  likelihood  associated  with  the 
distribution  in  (f).  Note,  also,  that  the  problem 
is  complicated  for  unknown  c  by  the  fact  that 
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increasing  the  number  of  dusters 

monotomcally  decreases  o2  Criteria  for  iaen- 

* 

tifying  an  estimate  for  c  is  discussed  later 

A  hierarchical  approach  to  minimizing  o2 

is  to  combine  nearest  neighbors,  by  an 
appropriate  metric,  into  a  new  point  (cluster) 
and  continue  the  process  until  all  points  have 
been  combined.  Thus,  a  hierarchical  tree  is 
formed  starting  with  n  (singleton)  clusters, 
that  reduces  the  number  of  clusters  by  one  at 
each  step.  At  each  step  the  criterion  (7)  is 
minimized  and,  therefore,  for  any  selection  of 
c,  an  appropriate  partition  is  achieved. 


It  is  readily  shown  that  the  metric  that 
achieves  the  above  result  is 


dmV  T  I|X*-X'"VKI 

where 

*k.“  [  Pr*  1 


(8) 

‘,9i 


Here,  the  points  xk  and  xt  with  Fisher  matrices 
Fk  and  Fj  are  combined  and  replaced  by  the  new 
point 

xki  "  Fkf1[Fkxk+  fixi]  ■  xk  ♦  Fki'lFixi  '"01 
and  new  Fisher  matrix 

Fki  ■  Fk  +  Fi-  ( 1 1 ) 


With  the  use  of  rough  screening  tests,  these 
computations  can  be  kept  reasonable.  In  tms 
manner,  global  estimates,  x,,  for  each  of  the 
formed  clusters  are  automatically  computed  in 
the  agglomerative  process,  see  Fig.  3. 

IV.  Refitted  Clustering  and  Estimation  Algo- 
nthms 


Selecting  a  criterion  function  is  critical 
to  both  cluster  formation  and  for  deciding  on 
the  number  of  clusters  present.  Measures  witn 
a  minimum  variance  flavor  are  popular  and  an 
generally  produce  the  same  good  results  when 
the  clusters  are  compact  and  well  separated 
When  the  clusters  are  close  together,  or 
overlap,  the  performance  degrades  rapidly  ana 
the  results  become  increasingly  sensitive  to 
the  criterion  or  metric  employed. 

To  place  the  problem  in  perspective,  a 
qualitative  analysis  based  on  identically 
distributed  Gaussian  clusters  shows  that  both 
the  hierarchical  tree  approach  to  clustering 
(partitioning)  described  in  Section  III.  and  ^n_ 
simplified  criterion  for  determining  the  number 
of  clusters,  c.  oertorm  well  for  separations  of 
the  cluster  centers  on  the  order  of  d  s  v  if  a 


or 


^n/ 


Availability  Codes 
Avail  aod/or 
Dlst  |  Special 


□  □ 


A  possible  criterion  for  determining  c  is  to 
minimize 


where  g(c)  is  a  monotonicaily  increasing 
function  of  c.  On  the  other  hand,  when  the 
centers  are  very  close  together,  d  s  vi2/n  a, 
smaller  estimation  errors  result  by  assuming 
one  cluster  even  when  two  or  more  clusters  are 
present.  At  this  point,  separation  of  the 
clusters  is  no  longer  reasonable.  Consequently, 
it  is  noted  that  much  research  on  this  subject 
is  directed  at  achieving  efficient  techniques 
that  work  in  thf.  approximate  range 
d/o  -  v  1  iz/n  to  '1 12.  see  Fig.  4.  it  is  reported 
that  use  of  mixture  density  ML  techniques  [6] 
extends  the  limits  of  reasonable  performance 
oy  approximately  3  dd  i.e..  down  to  separations 
on  the  order  of  d  -  Ve  cr.  Currently,  separation 
below  this  level  is  questionable  and  at  best 
sensitive  to  a  priori  models  and  dependent  on 
data  rich  environments.  Therefore,  we  restrict 
the  scope  of  this  paper  to  the  consideration  of 
cluster  separations  that  permit  tne 
aggiomerative  hierarchical  methods  of  Section 
ill  to  fuse  data  from  angle-of-arrival  sensors, 
it  is  noted  that  divisive  techniques  (cluster 
splitting)  are  available  to  refine  the  results. 
Here,  dimensionality  reduction  to  one 
dimension  is  achieved  by  proiection  pursuit  or 
oy  projections  onto  the  dominant  eigenvector  of 
the  resulting  scatter  matrix  of  the  formed 
cluster.  These  projections  can  be  used  to 
efficiently  compute  new  trial  partitions  of  the 
agglomeratively  formed  clusters  to  maximize 
the  mixture  likelihood  (6).  Use  of  the  estimate, 
x,.  to  initialize  maximum  likelihood  estimation 
algorithm  has  also  been  suggested.  However, 
ittie  change  in  the  estimates  is  expected  for 
widely  separated  clusters  and  degradation  of 
the  information  content  of  the  data  (due  to  the 
nonassociated  nature  of  the  data  [5])  occurs 
when  the  clusters  overlap. 

This  paper  extends  the  results  of  the 
single-contact  trajectory  estimation  problem 
with  segmented  data  [3]  to  the 
multisensor-multicontact  problem.  In  the 
application  to  trajectory  estimation  from 
angle-of-arrival  data  the  measurements,  <Xj,  are 
a  nonlinear  function  of  the  state  of  the  body 
under  observation,  i.e..  ctj-a(x).  Similar  to  the 
single-contact  problem  f  3  ] .  for  the 
muitisensor-multicontact  problem,  we  seek 
the  x(  such  that 

e  2 

ow2  -  I  I  i!<*i  -  ot(Xj)  i|p.  (13) 

I*'  o,tAj  ' 

s  minimized. 


V  FUSING  ANGuE-QF  ARRIVAL  DATA 

The  decision-directed  approach  is  now 


applied  to  the  specific  problem  of  estimating 
trajectories  from  angle-of-arrival  data  m  a 
muitisensor-multicontact  environment.  For 
associated  data,  the  estimation  problem  is 
detailed  in  [3. 7, a].  Oata  streams  are  locally 
processed  to  extract  (sufficient)  statistics  or 
features.  This  reduced  data  set  is  then  used  to 
represent  the  raw  data  at  higher  levels  m 
hierarchical  approach  tor  associating  the 
elements  within  this  reduced  data  set.  For 
simplicity,  contact  motion  is  assumed  to  be 
constant  velocity  while  observer  motion  is 
confined  to  constant  velocity  ’legs*  separated 
by  velocity  shifts  (maneuvers).  Because  of  the 
nature  of  the  bearings-only  observation 
process,  two  independent  data  segments  are 
required  for  the  contact  trajectory  to  be 
observable  [3.7,8].  The  association  criteria 
are  based  in  the  contact  state-space  and  the 
following  procedure  is  employed: 

'Sufficient  statistics,  a;,  are  extracted  by 
locally  processing  segments  of  bearing  data. 

•Primary  cluster  estimates,  x,,  are  formed 
from  all  combinations  of  independent  oata 
segments  taken  two  at  a  time. 

'These  primary  estimates  serve  as  the 
observations  in  the  contact  state-space  used  m 
the  clustering  process  described  in  section  ill 
Because  eacn  primary  observation  requires  two 
data  segments,  individual  data  segments  mav 
appear  in  more  than  one  cluster.  This  s 
minimized  through  selective  cluster  pruning. 

'At  each  level  of  the  hierarchical 
procedure  the  cluster  set  is  sorted  and  clusters 
which  appear  as  subsets  of  others  are  removed. 
Primary  clusters  whose  segment  sets  are 
divided  between  two  non-primary  clusters 
(consisting  of  more  than  two  segments)  are 
also  removed  as  pairings  of  assumed 
non-associated  segments.  Pruning  in  th'S 
manner  greatly  reduces  the  required  number  of 
levels  in  the  hierarchical  procedure. 

*At  each  level  of  the  tree,  once  two  points 
have  been  combined,  all  segments  associated 
with  the  combined  points  are  reprocessed  to 
refine  the  estimate  by  minimizing 

ow2  =  I  ||  Oj  -  a(x)  || 2  (14;. 

at£Aj  1 

and  the  new  information  matrix  is  determined. 
This  new  (weighted)  cluster  center  and  Fisher 
matrix  are  used  in  the  next  step  of  the  process. 

•This  process  continues  until  the 
estimated  number  of  clusters  is  declared.  At 
this  point  some  data  segments  may  appear  in 
more  than  one  cluster  presenting  a  conflict  m 
association.  Due  to  the  sequential  nature  of  the 
tree  it  is  also  possible  for  a  segment  to  be 
wrongly  assigned  to  one  or  more  clusters 

'Conflicts  are  resolved  by  iterauveiy 
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^assigning  segments  to  clusters  based  on 
minimizing  the  contribution  to  the  residual 
error  (13). 

*The  resulting  (weighted)  cluster  centers 
are  the  estimated  states  or  trajectories  of  the 
contacts.  Confirmation  of  a  contact  is  not 
possible  when  a  cluster  contains  only  two  data 
segments. 


IV.  EXPERIMENTAL  RESULTS  AND  COMMENTS 

Experiments  were  conducted  on  simulated 
data.  The  test  scenario  is  given  in  Fig.  5  where 
there  are  a  total  of  5  nearly  stationary 
contacts  being  tracked.  There  are  5  observer 
"legs"  along  the  path  O-A-O-B-O-C;  data  are 
received  on  all  contacts  on  the  first  leg.  the 
first  four  contacts  on  the  second  leg,  the  first 
three  on  the  third,  etc.  This  provides  a  total  of 
15  segments  of  bearing  data  for  fusion.  A 
nominal  zero-mean  white  gaussian  noise  is 
added  to  the  bearing  measurements.  All 
estimates  are  formed  at  initial  time,  and  range 
is  normalized  to  the  true  rango.  Three  separate 
test  runs  are  presented:  case  I  with  all  five 
contacts  present,  case  II  with  contacts  1,2.3. 
and  case  ill  with  contact  1  alone. 

Fig.  6  is  a  scatter  plot  of  the  primary 
clusters  for  case  I  where  estimates  which 
violate  an  upper-bound  speed  constraint  have 
been  pruned.  This  represents  the  first  level  in 
the  hierarchical  tree.  As  weighted  nearest 
neighbor  clusters  are  grouped  and  the  cluster 
sets  that  appear  as  subsets  of  others  are 
pruned,  the  total  number  of  clusters  is  reduced. 
Fig.  7  is  a  scatter  plot  of  the  set  of  cluster 
centers  at  the  8th  level  of  the  tree.  Fig.  8  is 
for  the  11th  level,  where  the  number  of 
segments  associated  with  each  cluster  center 
is  also  indicated.  The  total  residual  power 
versus  the  number  of  clusters  is  shown  in  Fig. 
9.  Behavior  of  the  residual  power  in  the 
vicinity  of  the  correct  value  of  c  may  be 
exploited  along  with  other  clues  or  critera  to 
estimate  c.  in  this  experiment  the  criterion 
used  for  estimating  the  number  of  clusters  was 
simply  to  minimize  (12)  with  g(c)  ■  c.  Plots  of 
this  function  versus  the  number  of  clusters  are 
also  shown  in  Fig.  9.  While  this  criterion  is 
appealing  for  its  intrinsic  simplicity,  improved 
performance  requires  a  more  refined  technique 
such  as  use  of  the  mixture  density  (6).  Using 
this  criterion,  good  results  were  obtained  in 
cases  I  and  II.  However,  two  closely-spaced 
clusters  were  estimated  for  case  III.  where 
only  a  single  contact  was  present,  due  to  the 
increase  <n  residual  power  when  a  single 
cluster  is  formed.  This  effect  was  dependent 
on  the  particular  noise  sequence.  Fig.  10 
illustrates  the  clustering  for  all  three  cases 
after  the  iterative  optimization  of  the  segment 
assignments.  No  change  is  made  in  the 
estimated  number  of  clusters,  and  segments 
are  simply  reassigned  as  necessary  to  remove 
conflicts.  It  is  important  to  note  that  the 
fourth  and  fifth  contacts  in  the  case  l 


scenario  represent  unconfirmable  (with  only 
two  data  segments  associated  to  it)  and 
unobservable  (only  a  single  segment  associated 
with  it)  contacts,  respectively.  In  this  case, 
clusterings  for  contacts  1,2  and  3  represent 
confirmed  contacts,  where  the  number  of  data 
segments  assigned  to  each  cluster  is  as 
indicated  on  the  figure. 

While  the  approach  taken  is  direct,  a 
certain  elegance  may  be  found  in  that  decisions 
on  the  association  of  data  segments  with 
contacts  are  not  made  until  it  is  necessary  to 
do  so.  The  observability  problems,  of  using 
bearings-only  data  require  the  formation  of  a 
primary  observation  set  prior  to 
implementation  of  the  clustering  procedure. 
However,  through  selective  pruning  at  each 
level  of  the  hierarchical  tree,  the  observation 
set  is  quickly  reduced  by  removing  subset  and 
"illegal"  states.  Thus,  while  the  primary 
observation  set  may  be  quite  large,  the 
hierarchical  tree  quickly  converges.  The 
subsequent  evaluation,  on  a  segment  by 
segment  basis,  of  the  residual  power 
contribution  of  each  segment  to  each  cluster 
permits  resolution  of  any  conflicts  as  well  as 
optimizing  the  segment  assignment. 
Performance  of  this  optimization  phase  is 
dependent  on  the  proper  estimation  of  the 
number  of  contacts  present,  and  further  work  is 
required  in  this  direction.  When  the  number  of 
clusters  is  correctly  estimated,  the  clustering 
generated  by  the  tree  is  generally  quite  good 
and  needs  little  refinement.  However,  the 
construct  of  the  tree  does  allow  conflicting 
segment  assignments  and  resolution  of  these  is 
still  necessary. 
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Fig.  10*.  Final  cluster  center*  (CM*  1).  Numerical  values 
indicate  numocr  of  data  segment*  assigned  to  each  ciuator. 
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NORMALIZED  X-POSITION 

Fig  tOd.  Final  cluster  center*  (caaa  2).  Numerical 
values  >ru»cata  number  of  data  segments  assigned 
to  aac h  cluster. 


-0  t0.-0.08  -006  -004  -0  02  0.00  0  02  0  04  0.06  0  08  3  '•  0 


NORMALIZED  V-POSITION 

Fig.  '0e.  Final  cluster  can  tar*  (caaa  3).  Numerical  value* 
indicate  number  of  data  segments  assigned  to  each  cluster 


6 


^FENCES 


i  F.  S.  Cohen,  2.  Fan.  “System  identification  from 

Unlabelled  Samples"  Proceedings  of  the  20th  Asilomar 
Conference.  Pacific  Grove.  CA.  Nov.  1986. 

2.  D.  V.  Lindley,  "The  Use  of  Prior  Probability 

Distribution  in  Statistical  Inference  and  Decisions.' 
Proceedings  of  the  Fourth  Berkely  Symposium  of 
Mathematical  Statistics  and  Probability,  Berkeley  and 
Los  Angeles.  University  of  California  Press.  Vol.  t 
1961 . 

3  A.  G.  Lindgren.  K.F.  Gong,  and  M.  L.  Graham. 

“Nonlinear  Parameter  Estimation  with  Segmented  Oata: 
Trajectory  Estimation  with  Biased  Measurements." 
Proceedings  19th  Asilomar  Conference  on  Signals. 
Systems  and  Computers.  Nov.  1985. 

4  R.  O.  Duda  and  P  E.  Hart.  Pattern  Classification  and 
Scene  Analysis.  John  Wiley  and  Sons  Inc.,  New  York 
1973. 

5.  A.  G.  Undgren,  S.  C.  Nardone  and  J.  Irza.  "Traiectorv 
Estimation  with  Uncertain  and  Nonassociated  Oata." 
Transactions  on  Aerospace  Electronics.  Vol.  AES,  No.  1. 
Jan.  1986. 

5.  F.  C.  Cohen  and  2.  Fan.  "System  Identification  from 

Unsupervised  Samples.’  to  be  presented  at  the 
Conference  on  Intelligent  Systems,  Netherland,  Dec. 
1986. 

S.  C.  Nardone.  A.  G.  Lindgren  and  K.F.  Gong, 

Fundamental  Properties  and  Performance  of 
Conventional  Bearmgs-Only  Target  Motion  Analysis." 
iEEE  Transaction  on  Automatic  Control.  Aug.  1984. 

3.  D.  J.  Murphy.  "Noisy  Bearmgs-Only  Target  Motion 

Analysis."  Ph.D.  thesis.  Northeastern  University. 
Boston.  MA  1970. 


Acknowledgment 

This  study  was  conducted  under  the  Underwater  Combat  Control 
Technology  Program  sponsored  by  the  Office  of  Naval  Technology, 
program  manager  0.  Houser  (OCNR-232),  NUSC  program  manager 
i.S.  Oavts  iCode  221). 


